Feedback cooling, measurement errors, and entropy production 
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The efficiency of a feedback mechanism depends on the precision of the measurement outcomes 
obtained from the controlled system. Accordingly, measurement errors affect the entropy production 
in the system. We explore this issue in the context of active feedback cooling by modeling a typical 
cold damping setup as a harmonic oscillator in contact with a heat reservoir and submitted to 
a velocity-dependent feedback force that reduces the random motion. We consider two models 
that distinguish whether the sensor continuously measures the position of the resonator or directly 
its velocity (in practice, an electric current). Adopting the standpoint of the controlled system, 
we identify the 'entropy pumping' contribution that describes the entropy reduction due to the 
feedback control and that modifies the second law of thermodynamics. We also assign a relaxation 
dynamics to the feedback mechanism and compare the apparent entropy production in the system 
and the heat bath (under the influence of the controller) to the total entropy production in the 
super-system that includes the controller. In this context, entropy pumping reflects the existence 
of hidden degrees of freedom and the apparent entropy production satisfies fluctuation theorems 
associated to an effective Langevin dynamics. 

PACS numbers: 05.40.-a, 05.10.Gg, 05.70.Ln 



I. INTRODUCTION 



Active feedback cooling is a well-established technique which is used to reduce the effective noise temperature of me- 
chanical oscillators well below their operating temperature. It is now used in a wide variety of nano-electromechanical 
systems, and is a key ingredient for measuring force and mass with very high sensitivity, for limiting thermal noise in 
gravitational waves detectors, and for reaching the quantum regime of mechanical motion 1J. A commonly used pro- 
cedure named cold damping consists in measuring the resonator displacement in real time and then applying through 
a feedback loop a velocity-proportional external force that increases the damping rate. As a result, the Brownian 
motion of the resonator (for instance, the mirror of an interferometric detector [2] or the cantilever of an AFM[3]) is 
reduced. Ultimately, the feedback cooling efficiency (that is the minimum achievable temperature) is bounded by the 
noise of the detector, that is by the errors in the measurements. 

Such a feedback loop thus plays the role of an external agent that detects the microscopic state of the system and 
then acts to modify its dynamical evolution. It is therefore natural to wonder how the information acquired through 
the measurement modifies the thermodynamics of the system, in particular the entropy balance equation and the 
second law. This issue, which is at the crossroad of information theory and nonequilibrium statistical mechanics, has 
attracted much attention recently [1HTS], in relation with significant advances in single- molecule manipulations and 
new fundamental developments in the stochastic thermodynamics of small systems[16 18 . Within this framework, 
nonequilibrium relations such as Jarzynski equality[TS] and fluctuation theorems (FT) [30] have been generalized to 
systems under discrete feedback control by taking into account the mutual information between the state of the system 
and the measurement outcome. Mutual information quantifies the entropy reduction due to the interaction with the 
external agent (hereafter also called the controller) and provides a lower bound to the entropy production (EP) in the 
system. Measurement errors decrease mutual information, and thus limit the entropy reduction and the efficiency of 
the feedback control. 

These results, however, are not directly applicable to cold damping. First, measurements and actuation are per- 
formed continuously in this process, i.e., repeated with a period shorter than the characteristic time scales of the 
system dynamics. In practice, the motion of the feedback-cooled resonator in the vicinity of a resonant frequency 
is faithfully described by an underdamped Langevin dynamics. Second, the feedback controller is not a genuine 
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Maxwell's demon that only exchanges information with the system 1 . Indeed, the feedback force performs work on the 
system and the energetics (i.e. the first law) is thus modified. One expects the formulation of the second law to be 
modified as well, even for error-free measurements (in such a situation, mutual information diverges since observables 
are continuous jl 11 IT5] V This issue was first explored in |21) where it was shown that entropy is indeed continuously 
pumped out of the system by the external agent in the nonequilibrium steady state (NESS). This can be ascribed to 
the contraction of momentum phase space due to the additional damping. This entropy pumping modifies the second 
law, Jarzynski equality, and fluctuation theorems |22). The fact that the feedback force is velocity-dependent makes 
the formulation of the detailed FT somewhat peculiar, as stressed in a previous work [2"5]. 

The goal of this paper is to include the effect of measurement errors in this description. How is the entropy pumping 
in the NESS affected by the detector noise ? Although the influence of noise on the EP in a cold damping process 
has been explored in a recent work [23], this question has not been addressed [25]. Indeed, the quantity studied in 
[23] is the EP in the "super-system" that includes the Brownian entity (i.e. the resonator), the heat bath, and the 
feedback controller. The contribution of the controller to the EP is interpreted as resulting from the measurement 
process and is obtained by taking an appropriate continuous limit of a discrete series of noisy measurements 2 . In the 
super-system, the usual second law is obeyed and entropy pumping plays no role. Furthermore, the EP diverges in 
the limit of error-free measurements and the results of [2T] 122] are thus not recovered. This clearly shows that the 
level of description of the system is different. To generalize the analysis of 21 23 , one must instead consider the EP 
from the viewpoint of the controlled system 3 : entropy pumping (like mutual information) then describes the entropy 
reduction due to the interaction of the system with the controller 12]. This is also the viewpoint adopted in the 
information-theoretic approach of control systems [26 . At this level of description, one is not interested in knowing 
the actual energy dissipation inside the controller nor in evaluating the "thermodynamic" cost of measurement [27] 
(see also [TS] and references therein) 4 . 

This important distinction between the two levels of description becomes even clearer when the controller has its 
proper dynamics. The super-system is then characterized by several (slow) degrees of freedom and adopting the 
standpoint of the controlled system means that the degree(s) of freedom of the controller is (are) projected out. In 
other words, the super-system is coarse-grained, which in turn changes the definition of the EP. This issue of coarse 
graining has also attracted much attention recentlv |29H37j . including on the experimental side |38j . As a rule, one 
expects that an incomplete description of the dynamics, due to the existence of hidden degrees of freedom or to a low 
resolution measuring apparatus, results in an underestimation of the EP in the full system. 

In this work, we shall indeed assign a relaxation dynamics to the controller. Physically, this may account for the fact 
that the feedback circuit cannot follow instantaneously the dynamics of the system when the resonator frequency is 
high (say above 1MHz). This makes the feedback control non-Markovian and degrades the cooling performance[T]. On 
the other hand, this procedure allows us to study the EP in a typical cold damping setup in which the position of the 
resonator (for instance a cant ile ver [31 I3T)H4"T] . a suspended mirror in a cavity[2], or an optically trapped microsphere [42 ) 
is continuously monitored. In this case, the velocity-proportional feedback force also includes the derivative of the 
detector noise 5 , which is obviously problematic when the noise spectrum is flat (i.e. the noise is white), as is usually 
assumed (see e.g. [21 [3] EI])- In this case, the relaxation time plays the role of a cut-off that regularizes divergent 
quantities. On the other hand, no regularization is needed when the measured observable is directly the velocity (in 
practice, the current in a RLC electric circuit), a situation that corresponds to the electronic feedback cooling schemes 
described in [431 - 145] . The theoretical analysis of this second setup is simpler and the Markovian limit of the feedback 
control is well defined (this is actually the case considered in [TT1 124"] ). 

The rest of the paper is organized as follows. In section 2, we specify the two models (hereafter called P for 
position and V for velocity) that are investigated and that correspond to the two experimental situations that have 
just been described. In section 3, we review the results of [2"Hf23] in order to make the whole story of the paper self- 
explanatory and coherent. In section 4, measurement errors are included and in section 4A model V is first studied in 
the Markovian limit. This is the simplest case for which the expression of entropy pumping can be generalized. The 
full versions of models V and P are then successively studied in section 4B and 4C. We summarize the main points 



1 Throughout this paper, the term 'feedback controller' denotes both the sensor that measures the state of the system and the actuator 
that modifies its dynamics. 

2 The relationship between a single noisy measurement of the velocity and the violation of the fluctuation dissipation theorem in a cold 
damping process is investigated in 

3 In this respect, the use of the term "super-system" in our previous work [23] was inappropriate. 

4 More generally, one does not gain much insight into the physics of the problem by investigating the EP in the super-system unless 
one has a precise description of the actual mechanisms that take place inside the controller. The case of genuine Maxwell's demons is 
different and the problem can be investigated on a case- by-case basis (see e.g. [28]). 

5 See e.g. Fig. 22 in pQ for a schematic diagram of a cold damping setup. 
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and conclude in section 5. Some additional (but important) calculations are detailed in three Appendices. 



II. MODELS AND EQUATIONS OF MOTION 



The physical systems studied in this paper are described by the underdamped one-dimensional Langevin equation 

mx + "t± + kx = Fth(i) + (1) 

where x(t) denotes the position of the resonator as a function of time, m is an effective mass, A; is a spring constant, 
and 7 is a linear damping. As usual, the resonator dynamics can be also described in terms of the angular resonance 
frequency ujq = \fkjm and the intrinsic quality factor Qq = lliqTq = y/mk/^f, where To = 771/7 is the viscous relaxation 
time. Eq. ([!]) correctly describes the small displacements of nanomechanical systems around the resonance frequency 
of a normal modep]. Alternatively, it may also describe a RLC electrical circuit: x(t) then represents the charge of 
the capacitor whereas the velocity v(t) = x(t) is the current through the inductor (with the resistor R, inductor L, 
and capacitor C such that 7 = R/L, Wq — l/LC and m — L). One may also simply regard Eq. |l| as modeling the 
dynamics of a Brownian particle confined by a harmonic potential. 

Fth{t) — \/^lT represents the thermal random force generated by the surrounding medium at temperature T, 
and £(f) is a Gaussian white noise with zero mean and correlation < £(f)£(f') >= S(t — f') (for notational simplicity, 
Boltzmann's constant is adsorbed in the temperature throughout this paper). Pfb(f) is the velocity-proportional 
control force which is applied to the resonator via the feedback loop. We consider the following two models: 

(i) model V, in which the velocity v(t) is continuously measured and the output signal of the detector is v'(t) = 
v(t) + v n (t), where v n (t) is the measurement noise. The feedback force is then given by 

*fb(v) - -/»(*) (2) 
where 7' = 57 (g is the variable gain of the feedback loop), and y(t) obeys the differential equation 

y = -\[y-v'\ (3) 

where r is the relaxation time of the feedback circuit. 

(ii) model P, in which the displacement x(t) is the observable and the output signal of the detector is x'(t) = 
x(t) + x n (t), where x n (t) is the measurement noise. In this case 

F^y) = -iy{t) (4) 

where 

y = -~[y - A ■ (5) 

T 

Since it is generally observed that the power spectral density of the measurement noise is flat in the frequency band 
of interest, we assume that v n (t) and x n (t) are delta-correlated in time: 

v„(t) = y /r S^r)( t ) 

Xn{t) = y/ S Xn rj(t) (6) 

where 77(f) is a Gaussian white noise with zero mean and correlation < r)(t)r)(t') >— S(t — t'). We moreover assume 
that the two noises 77(f) and £(f) are uncorrelated and that the spectral densities S Vn and S Xn do not depend on the 
gain g, which is a reasonable approximation 6 . 

Model V is thus defined by the two coupled linear Langevin equations 



mi + 7± + kx + 7' 27 = \p2rff £ (f ) (7a) 
-ry + y-x = \/SV^ 77(f) , (7b) 



In experiments, the detector noise is usually obtained by fitting the measured spectral density with a theoretical expression such as Eq. 
jAllb) or Eq. l |A13b| (with r = 0). It is found that the noise parameters do not depend significantly on the feedback gain g (see e.g. 
|3J in the case of a mechanical resonator and 1451 in the case of an electrical resonator). 
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whereas model P is defined by 

mi + jx + kx + j'y = £(t) (8a) 

ry + y - x = y/S^r](t) , (8b) 

or better 

mx + ~/x + kx + —{x - y) = y/^yf £(t) - —y/S^vit) (9a) 




(9b) 

which is the form under which the model can be numerically studied. 

It is worth noting that the physical processes described by the above equations are Markovian if both x(t) and y(t) 



are observed, whereas the effective dynamics of x(t) obtained by solving Eqs. (FFb| or (9b) for y(t) and inserting the 



result into (7a) or (9a) is non-Markovian 7 . This transformation is discussed in detail in [J7J EE] an d more recently 
in |35j for a system of coupled linear Langevin equations quite similar to Eqs. ([7]). These equations were originally 
regarded as modeling the irreversible dynamics of a massive tracer in a granular fluid 49 , which is a quite different 
physical situation from the one considered here. However, the discussion in |35| about the influence of cross-correlations 
among different degrees of freedom on the entropy production is relevant to the present work. 

A Markovian description is of course recovered in the limit r — > as y(t) — > v'(t) and y(t) — > x'(t) in model V and 
P, respectively (note that the measurement itself is always Markovian since the measurement outcomes v' and x' do 
not depend on the state of the system at previous times) . The motion of the resonator is then simply described by 



mi + (7 + i)x + kx= v^TT^(t) - iv n {t) (10) 

in model V, and by 

mx + {^ + i)x + kx = ^2if(,{t)-ix n {t) (11) 



in model P. Eq. (10) with k = is the equation studied in pTJGI]. It also corresponds to a simplified version of the 



model considered in [35] that describes the feedback cooling of a macroscopic electromechanical oscillator. On the 



other hand, Eq. ( 11 ) is typically used to describe the feedback cooling of a cantilever [3J. It is clear, however, that this 
equation is ill-defined mathematically if x n (t) is a white noise. Therefore, as we already pointed out, the introduction 
of a finite relaxation time r may also be regarded as a way to circumvent this problem without having to describe 
the frequency dependence of the measurement noise, which is generally unknown. In practice, for the cooling to be 
efficient, r must be much smaller than 771/(7 + the effective viscous relaxation time of the feedback-controlled 
oscillator, so that y(t) (in model V) and y(t) (in model P) follow v(t) fast enough. In other words, the dynamics of the 
controller must be much faster than the dynamics of the system, otherwise the information about the instantaneous 
velocity is lost. 

III. ENTROPY PRODUCTION WITH ERROR-FREE MEASUREMENTS: A REMINDER 

The entropy production in a cold damping setup in the absence of measurement errors was first investigated in 
[2T1 [22] and revisited by us in a previous work [23 . The feedback force is given by 



Ffb(v) = -V«(t) (12) 
and the system is thus described by the Langevin equation 



mi + (7 + i)x + kx = V27T£(t) (13) 



7 The influence of memory terms on the behavior of feedback-controlled harmonic oscillators is also considered in [46| in reference to 
feedback-cooled electromechanical oscillators, such as the gravitational wave detector AURIGA 43 , 44 . In that study, however, the 
detector noise is not taken into account and the stochastic thermodynamics of the system is not investigated. 
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function Pt(x, v) at the ensemble level satisfies the Fokker-Planck (FP) equation 



which is also obtained from Eqs. (10 1 and (111 for v n (t) = x n (t) = 0. Accordingly, the probability distribution 

(14) 



1 



d t pt(x,v) = -d x [vp t (x,v)] H d v 



[kx + (7 + l')v]pt(x, v) H d v p t (x, v) 

m 



which is conveniently rewritten as 



1 



where 



d t p t (x,v) = -d x [vp t (x,v)] d v {-(kx + j'v)p t (x,v) + J t (x,v)] , 

m 



T 

J t (x,v) = -7[tH d v hx pt(x,v)]pt(x,v) 



(15) 



(16) 



is a probability current (in what follows, time is often put as an index for better readability). Although one can directly 
derive the entropy balance equation at the ensemble level 21J, it is helpful to consider the various thermodynamic 
quantities at the level of an individual stochastic trajectory, as done in |221 123 ) . in order to better understand the 
origin of entropy pumping. The ensemble average is then taken in a second stage. 

Let {x s } se [ 0j t] denote a trajectory generated by Eq. (13) during the time interval < s < t with an initial state 
drawn from some probability distribution po(x,v). Within the framework of stochastic energetics [16], the energy 
balance equation (or first law) is obtained by multiplying Eq. (13) by x t and integrating over the time interval [0,i]. 
This yields 8 



AE = w[{x s }] - q[{x s }] 



where 



AE = ds [mx 
Jo 

is the change in the internal energy of the (Brownian) system 



+ kx s ] oi s = - [v t 



2 vt] 



(17) 



(18) 



>{{x s }} = ds Ffb(a 
Jo 



ds xz 



(19) 



is the work done by the feedback force on the system, and 



q[{x s }} = I ds [yx a - v / 2tT£ s ] o x, 
Jo 



ds [mx s + 7 x s + kx s ] o x s 



(20) 



is the heat dissipated into the thermal environment 9 which can also be identified with an entropy increase in the 
medium As m [{x s }] = g[{a; s }]/T. The crucial point is that this quantity can also be written in the form[23 



AM{*.}]=Ing*#^4-£* 
7'-[{a; 8 }|a;o,«oJ m 



where 



V + [{x s }\x ,v ] oc exp 



7 + V , 
2m 



1 

WTJo 



ds {mx s + (7 + "f')x s + kx s y 



(21) 



(22) 



8 Throughout this paper, products of stochastic variables and stochastic integrals are defined within the Stratonovich interpretation and 
denoted by o. 

9 By convention, we assign a positive sign to q[{x s }] if the energy is dissipated into the bath. 
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is the conditional weight of the path {x s } s< z[ 0i t] given the initial point (xq,v ) and P-[{x 3 }\xo,vo] is the conditional 

weight of the time-reversed path {i s } s6 [o jt i (defined by x a = Xt- S , x s = — ± t _ s ) generated by the "conjugate" Langevin 
equation in which 7' is replaced by —7'. The additional term 

As pu = --i (23) 
m 

is interpreted as an "entropy pumping" arising from the contraction of momentum phase space due to the feedback 
force 10 . This is a unique feature of a velocity-dependent feedback control [3TJ [55]. As stressed in [33], the fact that 7' 
must be treated as an odd variable under time reversal in order to relate As m [{x s }] to the microscopic irreversibility 
of trajectories is not harmless: it implies that there is no steady state with the conjugate dynamics when 7' > 7, 
which is the common situation encountered in cold damping setups. 
Introducing the stochastic entropy of the Brownian system [ 



s sys (t ) = - In p t (x t , v t ) (24) 

where pt{xt,vt) is the solution of the Fokker-Planck equation evaluated along the trajectory, the entropy production 
for each realization of the stochastic process in the time interval [0,t] is then defined as 



?- [{*.}] 



a[{x s }} = In ^ + )/{ = As sys + As m [{x s }] - As pu (25) 



where 

Po(x 0) V ) 



A Ssys = ln " u »' " . (26) 
Pt(xt,v t ) 



As a direct consequence of Eqs. (21 1 and (26), tr[{x s }] obeys the integral fluctuation theorem (IFT) 

< e - ff K x «H >= 1 (27) 

where < ... > denotes a functional average over all paths {x s } s e[o.t] generated by Eq. ( Jl3| that start from (x ,v ), as 
well as averages over initial and final positions and velocities. One can also derive a detailed FT which has a nontrivial 
interpretation in the NESS because of the change of sign of 7', as discussed in [23]. From Jensen inequality, it follows 



from Eq. (27) that the average of c[{x s }] is a non-negative quantity and thus 

< As sys + As m [{x s }} > > As pu . (28) 

In other words, the total variation of entropy in the system plus the bath may be negative on average (which may 
look as a violation of the second law of thermodynamics if the role of the external agent is ignored) but this quantity 
is always bounded from below by —{^/m)t. In this sense, — As pu plays a role similar to mutual information in the 
generalization of the second law to systems under feedback control [13]. 

Upon averaging, £ =< (t[{x s }] >, Q =< <7[{a; s }] >, and AS rn = Q/T =< As m [{x s }] > become the non-equilibrium 
thermodynamic quantities defined at the ensemble level, and the corresponding averaged rates are given by [21 

t(t) = ±f dxdv- 1 ^ , (29) 
jT J Pt{x,v) 

Q 1 f 

S m (t) = f = ~t i dxdvvJ t{x,v) (30a) 

= T [<v2>t -^ ] (30b) 
where < v 2 >t= J dxdvv 2 p t (x,v). The entropy balance equation (or generalized second law) then takes the form 

±{t) = S sys {t) + S m (t) - S pu > (31) 



10 To trace back the origin of the term (7 + r /)t/(2m) in the path probability V+ [{x s }\xq, vq\, see e.g. [53H55] . The normalization factor 
cancels out when taking the ratio of the two probabilities. 
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with 

S P u = --- (32) 
to 

This equation can also be derived directly by taking the time derivative of the system Gibbs-Shannon entropy 

S sys (t) =< s sys (t) > t = - J dxdv p t (x,v)\np t (x,v) (33) 

and inserting the Fokker-Planck equati on (|15[ ). 

Note that Jt(x, v), as defined by Eq. (|16[), is actually the irreversible component of the total probability current [55] 



since 7' is odd under time reversal. Therefore, Eqs. (29) and (30a) are in agreement with the general definitions of the 
non-negative irreversible entropy production and of the heat flow in a stochastic system with odd and even variables 
(see e.g. [55J). 

The rates E and S m have simple expressions in the NESS where the solution of the FP equation has the form of 
an equilibrium Gibbs distribution 



, . Vkm _ kx 2 +mv 2 

Pst(x,v) — — — — e 2T ea (34) 



with an effective temperature lower than T 



Then 



T cff = to < v 2 > st = — —.T . (35) 
7 + 7' 



S = 0(i - ^) (36a) 



i 2 



TO (7 + 7') 

and 



(36b) 



• _ Q 7 T eff - T 

= ™ = ^ — (37a) 



T to T 
to(7 + 7') 



(37b) 



Hence, heat flows from the reservoir to the system on average, and Eq.(36a) merely describes the entropy flux between 
two objects at temperature T and T e g. 

IV. ENTROPY PRODUCTION AND ENTROPY PUMPING WITH MEASUREMENT ERRORS 

We now build on the analysis of the preceding section to study the EP in models V and P described by Eqs. ^ 
and respectively. Thanks to the linearity of the Langevin equations, the probability distributions and the power 
spectral densities can be explicitly calculated in the NESS and their expressions are given in Appendix A. 

A. Model V in the limit of a Markovian feedback 

We first study model V in the limit r = 0, that is when the feedback force is directly proportional to the output 
signal of the detector 

- + \fSZvit)] (38) 

and the Langevin equation reads 

mx + 7± + i[x + \fsZr)(t)} + kx = y/2jf f (i) . (39) 
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The first question that arises is whether the previous analysis at the level of an individual stochastic trajectory 
{£s}se[o,t] can be generalized. The key feature is that the probability of the trajectory only contains the total noise 
acting on the system. Indeed, since the sum of two independent Gaussian noises is also a Gaussian noise, the 
trajectories generated by Eq. (39) are also generated by the Langevin equation 



mi + (7 + i)x + kx = v/2( 7 T + 7 T') , 



(40) 



where T' = r y'S Vn /2 has the dimension of temperature and p(t) is a zero-mean, delta-correlated noise < p(t)p{t') >= 
S(t — t'). As a result, the conditional path probability "P+[{a; s }|2;o, vo] 1S given by Eq. (22) with T replaced by 
(7T + 7TO/7. It follows that 



ln P-[{i S }} ^ 



7 



7T + 7'T' 



ds [mx s + 7'x s + kx s ] o x s H £ 



(41) 



(noting that the product 7'T' = r y' 2 S Vn /2 is no affected by the change 7' to —7'). The problem is that this logratio 
cannot be considered as a sensible definition of the entropy production er[{a; s }] along the trajectory. In the first place, 
the second term in the right-hand side does not identify with As m [{X s }] = g[{X s }]/T, the entropy change in the 
medium, where the exchanged heat is defined in the usual way as 11 



<Z[{X S }] = f ds [jX s - yffiTt.] 

Jo 



ds [mx s + 7'y s + kx s ] o x s 



(42) 



As indicated, q and As m are now functionals of {X} se [ ,t] = ({^s}, {2/s})se[o,*l ( or functionals 



where y s - 

of the two noises {£ s } and {rj s }). In the second place, the average of Eq. (Hll in the NESS does not depend on the 



measurement noise. Indeed, since the stationary probability distribution is again given by Eq. (34) with an effective 
temperature 



m < v > st 



7 



7 



7 + 7' 7 + 7' 



(43) 



Eq. (41) yields 



t V-[{is}} 



77 

' 7T + 7'T' 

i 2 ^ 
m (l + 1') 



< V > s 



7 
rn 



(44) 



which is the same as Eq. (36b) for an error-free measurement 12 . Therefore, defining the entropy production from 



the microscopic irreversibility of the trajectories {x s } s e[o,t] is n °t pertinent in the present context (alternatively, one 
could consider the probability of {X} sg [ 0j t], but this amounts to changing the level of description of the system since 
y s is no more a "hidden" variable, as will be discussed below and in more detail in the next section). 

To bypass this difficulty and still define the EP and the entropy pumping for T' > 0, there is no other choice than 
to work at the ensemble level from the outset as was done originally in [2"T] . To this end, the different terms in the 
Fokker-Planck equation must be rearranged appropriately. From Eq. ( 40 ) , this equation reads 



d t p t (x,v) = -d x [vp t (x,v)] + —d v 

m 



, 7T + 7'T' 
[kx + (7 + j)v]p t (x,v) H d v p t (x,v) 



(45) 



which is conveniently rewritten as 



d t p t (x,v) = -d x [vp t (x,v)\ d v [-&a; + Ffb(t;,i)]pt(a;,«) + Jt{x,v) 

m 



(46) 



In this paper, following 16,57, wc define the heat as the work done by the "reaction" force ■yxt — y/^yT^t on the surrounding fluid due 
to the motion of the Brownian entity. This definition does not change in presence of a measurement noise. 

Since the probability of a trajectory is Gaussian in the NESS, it is of course crucial to change the sign of 7' when time is reversed. 
If not, the logratio would just predict a vanishing entropy production rate. This special property of linear Langevin equations will be 
encountered again in the next section and is discussed in detail in 1351 in the overdamped case. 
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where Jt(x,v) is defined by Eq. (16) and 



T 

F{b(v,t) = -7 [iH d v hxpt(x,v)] 



(47) 



plays the role of an effective (or apparent) feedback force. In this form, the FP equation is quite similar to Eq. 
(15) for T' = 0, that is for an error-free measurement. In particular, the probability current J t (x,v) keeps the 



same definition, which is justified by the fact that Eq. (30a) still gives the correct result for the average heat 



Q = TAS m =< q[{x s }, {y s }] >, where the average is taken over all possible realizations {£ s } and {rj s } of the noises 
in the time interval [0,i] 13 . 

Accordingly, the entropy balance equation obtained by taking the time derivative of the Gibbs-Shannon entropy is 
formally the same as for T' = 0, 



t(t) = S sys (t) + S m (t)-S pn (t)>0, 



(48) 



where E(t), the non-negative apparent entropy production rate , is given by Eq. (29), S m (t) is given by Eq. (30), 
and 



C M 1 ( A A I ^fbM) 

£pu(£j = — / dxdvp t (x,v) 

ml ov 



7 



r 



dxdv Pt(x, v) 



d 2 \np t (x, v) 
dv 2 



(49) 



Eq. ( 49 ) generalizes the entropy pumping in presence of measurement errors and is the main result of this section (as 

it must be, the results of [5T] recalled in section 3 are recovered for T' — 0, with S — > S). In general, the entropy 
pumping is time-dependent and the physical meaning of the second term in the right-hand side of Eq. ( |49[ ) is not 
transparent. Things become more intelligible in the NESS as the probability distribution p s t{x, v) has again the form 
of a Gibbs-Boltzmann distribution with T e g given by ( 43 1 . The apparent feedback force ( 47 ) is then proportional to 
the instantaneous velocity 



with an apparent damping coefficient 



Eqs. (29), (30a), and (49) then yield 



Ffb,st(v) = -j'v 



, eff — 1 1 — 1 eff 

7 — Tf, = 7" 



77 



T — T' 



(50) 

(51a) 
(51b) 



77' 2 



(T - T') 



IY2 



m ( 7 + y) ( 7 T + 7'T')T ' 



(52a) 
(52b) 



S m = % - — (T cS - T) 
1 m 



77 



T-T' 



777,(7 + 7') T 



(53a) 
(53b) 



13 This is because the Gaussian noises £(t) and r/(t) are independent. The average of the product £ s o x s in the first line of Eq. i |42[ ) is then 
equal to \J1^T j (2m), as can be shown by using Novikov's theoreml58| for instance. Therefore Eq. ( |30b| remains true and this result is 
also obtained from Eq. |30a|. 

14 The use of the term "apparent " borrowed from 1381 will be justified below in section 4B 
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and 



S pu = -- (54a) 
m 



77' T -T 
m 7T + 7T' 

Hence, the picture of heat exchange between two objects at temperature T and T c g is still pertinent in the NESS, 
with the measurement noise only increasing the value of T c g and thus reducing the efficiency of the cooling[l J. Eq. 



(51a I shows that this can also be interpreted as a weakening of the apparent feedback force, which in turn decreases 
the average heat flow coming from the reservoir and the apparent EP. We also remark that — S'pu decreases as T' 



Since S m — S pu > from Eq. (48) (as S syB = in the NESS by definition), the standard formulation of 
the second law is less and less "violated" as the measurement error increases, which again shows that entropy pumping 
plays a role similar to mutual information in the generalization of the second law 16 




FIG. 1: (a) Resonator temperature T e g/T as a function of the feedback gain g — 7V7 for a signa l-t o-noi se rati o SN R= 
■ZT/dSvn) = 1000. (b) Different contributions to the entropy production rate according to Eqs. (52b I, (53b I, and (54b I (in 

units fcsr _1 ): £ (b lack solid line), S m (red solid line), S pu (blue solid line). The dashed line is the total entropy production 
rate given by Eq. ( 59b I when the Langevin equation ( 39 1 is viewed as describing a Brownian particle coupled to two heat 



reservoirs. 



As shown in Fig. 1, the apparent EP rate £ has an interesting behavior as a function of the feedback gain g — 7V7, 
in relation with the behavior of the resonator temperature T e Q. As is well known in the theory of feedback coolingpQ|3] 
and is indeed observed experimentally (see for instance [45] for a setup related to model V), the temperature T e s 
reaches a minimum at a certain value g m %n of the gain for a given signal-to- noise ratio (SNR) 17 . Above g m in, too much 



Eq. ( 54b I can be written as 
Note that Eqs 



Q _ 7 7 



7+7' 



P u m m 7T+7T' 
(52)-(54) are not specific to a harmonic model and are more universally valid (e.j 



if one adds an additional quartic 

term in the potential) as long as the feedback force is proportional to the output signal of the detector, as given by Eq. (38). The 
stationary probability distribution is then still a Gibbs-Boltzmann distribution and the effective temperature is defined by Eq. (43). In 
parti cula r, the apparent feedback force keeps the suggestive form of Eq. (50). 

Eq. Jiil yields g min = + SNR - 1 and thus T effjmin = 2T( V / 1 + SNR - 1), where SNR= Sg" (u ) / Sv n is the ratio of the original 
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detector noise is fed back to the resonator and T e s starts to increase. In particular, T c g = T for g = IT j (jS Vn ) —SNK 
(which corresponds to X" = T): the resonator is then at equilibrium with its environment, as if there were no 
feedback. For even larger values of g, the resonator is heated. Interestingly, Eqs. (52) tell us that the apparent EP 
rate is maximal when T e g is minimal and, as can be seen in Fig. 1, the essential contribution to the EP around g m in 
comes from entropy pumping (\S pu / S m /\ g=gmin ps y/SNR/2). Loosely speaking, one may say that the optimal cooling 
is achieved when the controller extracts the maximal information about the state of the system via the measurement. 
This can also be put in relation with the behavior of the spectral density S v > v i (ui) of the output signal v' = v + v n , as 
noticed in [45 . Finally, we stress that the entropy pumping vanishes for T = T' like the heat flow from the reservoir, 
so that there is no EP on average, as the heating due to the detector noise exactly compensates the cooling due to 
the extra friction. 

At this stage, it is interesting to compare the above results to those obtained when Eq. (39) is regarded as a 



Langevin equation describing a Brownian particle coupled to two thermal environments at temperatures T and T". 
This is a model (with or without the harmonic trap) which is often discussed in the literature[32, 59 64 (see also [TS] 
and the recent experimental work described in [65]) as it is probably the simplest example of heat conduction. In 
this interpretation, the heat flowing from each thermostat to the particle drives the system out of equilibrium, and 
to correctly distinguish the two heat flows the Fokker-Planck equation ( 45 ) is written as 



where 



d t pt(x,v) = -d x [vpt(x,v)} d v \—kxp t (x,v) + J t (x,v) + JUx,v)] 

m 



T' 

J t (x,v) = -7 [iH d v 1npt(x,v)]pt(x,v) . 



(55) 



(56) 



This leads to the entropy balance equation (see e.g. [3"2"] ) 



£(*) = S sys (t)+S m (t) + S m ,(t) , 



(57) 



where S m >(t), the entropy flow to the second reservoir, is defined like S m (t) (with T and Jt(x,v) replaced by T' and 
J' t (x,v), respectively), and 



S(t) 



1 

IT 



dxdv 



1 



Pt(x,v) 7'T' 



dxdv 



In the steady state, this yields 



, T T , 



(T — T 



where 



Q = TS m = ^(T eS -T) 



J't 2 (x,v) 
Pt(x,v) 



7\2 



m(7 + 7') TT' 



(58) 

(59a) 
(59b) 



-T'S n 



m 



"(Teff-T') 



(60) 



Eq. ( 59b ) is the usual thermodynamic expression for the average EP rate associated with a steady heat flux between 
two reservoirs mediated by a device with thermal conductivity 77V \m (7 + 7')] (see e.g [321 [51 



is quite different from the average apparent EP r ate given Eq. ( |52bj (whereas Q does not change). Indeed, Eq. ([52a 
has not the same physical content as Eq 



(59a 



). This expre ssion 



since only the two temperatures T and T e g come into play in the 
former case and T' is only introduced for convenience (changing T' changes the value of T e fj). In other words, at 
the level of description corresponding to Eq. ( 52 ) , the entropy exchange with the external agent is not associated 



with another heat flow but only manifests itself in the form of entropy pumping. This makes a big difference since 



thermal noise peak (i.e.. 
T'/T = g/SNR. 



without feedback) to the detector noise floor. From Eq. ( |Alla| with r = 0, SNR= 2T/(yS Vn ). Hence 
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the average EP rate given by Eq. (52b I rem ains finite when the measurement becomes error-free (T" — > 0) whereas 
S m ' — Q/T' and thus £ given by Eq. (59b) diverge 18 (see [28] for a closely related discussion in the case of a true 



Maxwell demon). Moreover, as a function of g, £ does not display any extremum at g = g m im which shows that 
this quantity does not reflect the interesting physics of the problem. More fundamentally, there is no rationale for 
considering T" as the genuine temperature of another reservoir in the context of cold damping. It it worth noting, 
however, that Eq. (59b) is also the expression of the average EP resulting from the analysis performed in [24], as can 
be readily checked. In this work, the Langevin Eq. (39 1 (with k = 0) is obtained by taking a suitable continuous-time 
limit of a discrete series of independent measurements of the velocity (as originally considered in |llj) 19 . A quantity 
that identifies with AS m > (the change in entropy of the second "heat" reservoir) is then interpreted as the "entropy 
production due to the measurement process" and contributes to the total EP. In the light of the above discussion, it 
is clear that this corresponds to another level of description of the system. We shall come back to this issue in the 
next section and in Appendix C. 



Now that we have defined the average (apparent) EP rate associated with the Fokker-Planck equation (46), let 
us again consider individual trajectories and see whether we can define a corresponding (apparent) EP functional. 
The main problem is to relate the entropy pumping to a momentum phase space contraction like in the case T' = 0. 
To simplify the discussion, and also because this is the normal regime of a cold damping setup, we only consider 
stationary trajectories. Then, Eq. (50) immediately suggests to replace the original Langevin equation (39) by the 
effective equation 



(7 + j')x ■ 



which can be rewritten, using Eq. (51a), as 



rax + 7 



T 

T H 



x + kx = y/^yf^t) 



(61) 



(62) 



By construction, this equation leads to a NESS with the same probability distribution p st (x,v) as Eq. (39). On the 
other hand, the individual stochastic trajectories are different. Since only the Langevin thermal noise £(i) appears in 
Eq. (62), we are led back to the problem treated in [2lTf23] and recalled in section 3. Hence, the apparent entropy 
change As m [{x s }] 



q[{x s }]/T, where (^[{a^}] is the apparent heat dissipated in the environment defined by 

q[i x s}] = ds[r 
Jo 



+ 7 x s + fca 



also satisfies Eq. (21) with 7' replaced by 7' everywhere. It follows that the apparent path-dependent EP 



~rr ii _ , ^+ [{ x s}] 

a[{x s }} =ln 

V-[{x s }} 



= At 



As m [{x s }] 



(63) 



(64) 



where ? + ({a; s }] (resp. P_[{a; s }]) is the probability of a path {x s } sS [ ,t] generated by Eq. (62) in the NESS (resp. by 
the conjugate equation with 7' replaced by —7'), satisfies the IFT < e _ff K Xs ^ > ef f st = 1. A proper detailed fluctuation 



theorem can be also obtained following [23] • By construction, (1/t) < a[{x s }] > e //,st and (l/t) < q \\x s }] > e //, s t 
identify with the average apparent EP rate and the average heat flow Q given by Eqs. (52b) and (53b), respectively. 



(39 



Let us finally remark that the effective Langevin equation can also be derived from the original Langevin equation 
by replacing the measurement noise n(t) by its projection onto the space spanned by the stochastic variables x 



and v, which is defined as 



fj s t(x,v) = 



< n o x > 

< x 2 > st ' 



< rj o v > 
o '< 

< v 2 > st 



(65) 



Since < i] o x >— and < 77 o v >= — \ / 2j'T / / (2m), one has ij s t = V^l'T'/ (2T g) v and Eq. (62) is recovered by 
inserting this result into Eq. ( 39 ) . This procedure will be useful to derive similar effective Langevin equations in what 
follows. 



More generally, the EP rate given by Eq. \29[ , which leads to Eq. |[52bjl in the NESS, is always smaller than the EP given by Eq. 
| |58| l since the contribution involving Jj- 2 (x, v)/pt(x, v) is not present. In the NESS, the difference between the two EP rates become 
asymptotically zero in the large g limit, as can be seen in Fig. 1. 
Specifically, the conditional probability for obtaining the measurement outcome y(t) from the velocity v(t) is given by a Gaussian 
distribution with variance A 2 8t where A quantifies the error and St is the infinitesimal time step. T he li mit A — > 00 and 8t — » is then 
taken such that A 2 St — > 2c*o finite. Hence 2oq identifies with the noise spectral density Sv n in Eq. 1391. 
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B. Model V for r > 



We now generalize the above analysis to the case r > 0. Whereas Eqs. ^ describe the coupled dynamics of the 
two processes x(i) and y(t), we are interested in the apparent entropy production associated with x(t) only. Like in 
the overdamped case considered in [35], the coupling makes the effective dynamics of x{t) no longer Markovian, as we 
have already noticed. However, since the Langevin equations are linear, the path probability ? + [{i s }] is Gaussian in 
the NESS, and the ratio 7- > +[{:r s }]/'P_[{i s }] can be easily computed by going to Fourier space, as shown in Appendix 
B. It turns out that the average of this quantity is independent on the measurement error, like for r = 0. Therefore, 
again, we cannot define an apparent EP functional from the microscopic irreversibility of the trajectories {x s } and 
we need to first derive the entropy balance equation at the ensemble level. 

We thus consider the time evolution of the Shannon entropy S sys (t) = — J dxdv pt(x, v) lnp t (x, v ) where pt{x, v) is 
the marginal of the joint distribution Pt(X) = p t (x,v,y) which obeys FP equation (A2|. Specifically, for model V, 



0tPt(X) = -d x [vp t (X.) 



±d v [-[kx + 7 'y}p t (X) + J t (X)]--d v [(v-y) Pt (X)-^-d vPt (X)] (66) 
m 1 J t 1 j't 



where 



•MX) 



-7[u ■ 



-d v lnp t (X)] Pt (X)) 



(67) 



and T' = 7' S Vn /2 like before. Integrating over y yields the FP equation for pt(x, v), 

1 



d t pt{x,v) = -d x [v Pt (x,v)] - —d v 

m 



-kx + F^x^v^t^p^x^v) + J t (x,v) 



where the current 



J t (x,v)= / dy J t (X) = -j[v H d v \np t (x,v)}pt{x,v) 

J m 

has the same definition as before, and the apparent feedback force is now defined as 

Ffb(x,v,t) = —Yy(x,v,t) 

where 

1 



y(x,v,t) = / dyyp t (y\x,v) 



Pt(x,v) 



dyypt(X) 



(68) 



(69) 



(70) 



(71) 



Therefore, the only difference with the preceding calculations for r = lies in the definition of Ffbjx, v, t). By taking 

the time derivative of S sys (t), we thus again obtain Eq. (48) with and S m (t) given by Eqs. (29) and (30), 
respectively, whereas the entropy pumping is now given by 



Spu(t) 



1 

rn 



dxdv pt(x, v) 



dF^{x,v,t) 
dv 



m 



dxdv Pt{x, v)d v y(x, v, t) 



(72a) 
(72b) 



The physical meaning of this contribution is again more transparent in the NESS where p st (X) is given by the Gaussian 
distribution (A3) and the effective (kinetic) temperature is 



r (f) 

( eff 



mcr 2 ,2 



7eff ~ 7 
7eff 



T 



7off 



r 



(73) 



with 7 e fj defined by Eq. ( A6 ) . A straightforward calculation then yields 
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where the elements of the covariance matrix <x are given by Eqs. ( A5 1 . The apparent feedback force defined by Eq 



( 70 1 thus includes an additional contribution proportional to the instantaneous position of the resonator. However, 



from Eq. (72), only the viscous part of Fa>st(x, v ) contributes to the entropy pumping and the rate can be again 



expressed as S pu = —7' /to with an apparent friction coefficient 

/°2,3 



7 = 7 



02,2 

T-T 



(v) 



= 7- 



T 



(r) 



(75a) 
(75b) 



where Eq. (A7a) has been used to go from Eq. (75a I to (75b) (note that 7' 7^ j'iT^p — T')/T$, in contrast with 
Eq. (51a)). Specifically, we obtain 



'off 



77' 
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) 

{T-T 



l\2 



mjeff [(7efi - l')T + 7'T']T 



(76a) 
(76b) 



a = Q_ li T-T 

T TO7 eff T 



and 



77 



T-T 



m (7 cff - y)T + 7'T' 



(77) 



(78) 



which generalize Eqs. (52), (53), and (54), respectively. Since 7 c ff — > 7 + 7' when r — > 0, these equations are recovered 



in this limit, as it must be. Furthermore, the apparent EP still reaches a maximum as a function of the gain g — 7V7 
when T g is minimal. 

Following the same line of reasoning as for r = 0, we can introduce an effective Langevin equation that reproduces 

the same average heat flow Q and the same average EP rate E in the steady state as the original model while allowing 
to properly define corresponding fluctuating quantities. The Fokker-Planck equation (68) suggests to simply replace 



the actual feed back force by the apparent one defined by Eq. (70), that is to replace y by y s t(x, v) in Eq. (7a). From 
Eqs. (74) and (75a), the effective Langevin equation thus reads 



mx + (-y + j')x + (k + "f'^)x = v^yrcW . 

01,1 



(79) 



which can be rewritten, using Eqs. (A7), as 



mx + 7 



T 



(v)- 



T 



(v) 



/ T „ 



.T 



(x) 



cfr 



(80) 



where = k < x 2 > s t— kai,i is another effective temperature characterizing the motion of the Brownian entity 20 
(see below section 4C). By construction, this equation leads to the same marginal distribution p st {x,v) as Eqs. 
The apparent heat dissipated in the environment is then given by 



q[{a; s }] = TAs m [{x s }} 



ds [mx s + j'y s t(x s ,x s ) + kx s ] o x s , 



(81) 



and the corresponding apparent EP functional a[{a; s }] = As sys + As m [{a; s }] + (^'/m)t gives back Eq. (76) upon 
averaging. The reason for using the term "apparent" like in |38j should now be clear. Apart from the presence of 



Note from Eqs. 1 A5 1 that T^) = T^' = T when T" = T. The Brownian entity is then at equilibrium with the environment. One also 



has T 



(«) 



Tj' for t = so that Eq. (|S0b gives back Eq. 162k, as it must be 



15 



the entropy pumping contribution, which is specific to the present problem, the definition of the path-dependent 
apparent EP is the same as the one introduced in |38j for an overdamped dynamics 21 : the total force acting on 
the observed particle, which depends on the "hidden" degrees of freedom (here, y), is replaced by its conditional 
expectation, that is by its projection on the subspace spanned by the accessible degrees of freedom (here, x and v) 22 . 
By definition, one has o-[{a; s }] = lnP + [{x s }]/P_[{x s }] ^ ln7- > +[{a: s }]/'P_[{a; s }], which implies that the apparent EP 
functional obeys a FT with the trajectories {x s } S £[oj] generated by the effective Langevin equation instead of the 
actual trajectories generated by Eqs. ^ 23 (here P_[{i: s }] is the probability of the time-reversed path generated by 
the Langevin equation conjugate to Eq. ( |79[ ) in which the apparent friction coefficient 7' is replaced by —7' and the 
other terms are unchanged). 

Of course, a more standard picture is recovered if one considers the EP along trajectories {X s } se r 0)t i = 
({x s }, {y s }) S £[o,t] m the "super-system". As already stressed, this is not the viewpoint adopted in this work, in 
contrast with [21]. Moreover, this EP is rather artificial in the present context since Eqs. ^ do not describe the 
actual physical processes inside the controller. On the other hand, the comparison with the apparent EP defined above 
may be interesting from the perspective of the influence of coarse graining on entropy production, in particular in the 
light of the analysis carried out in [35] • Indeed, if one forgets the harmonic potential kx 2 /2, model V is identical to 
the two-temperatures underdamped model considered in |35j (Appendix B) that describes the irreversible dynamics 
of a massive tracer in a granular fluid |47tfi5] . For completeness, and also because this sheds some light on the analysis 
of [21 , the calculation of the EP in the super-system (the "total" EP) is detailed in Appendix C. Note in particular 
Eq. ( C15 1 which states that the average total EP rate is always larger than the average apparent EP rate. This 



is consistent with the general expectation that an incomplete description of a system results in an underestimation 
of the actual dissipation. However, in the present case, since cf[{a; s }] ^ ln'P_|_[{a; s }]/'P_[{i; s }], this inequality does 
not follow from the general argument that a Kullback-Leiblcr divergence (or relative entropy) always decreases upon 
coarse graining|66j (see also [31]). 



C. Model P 



Since it would be tedious to repeat everything for model P, we only point out the main differences with model V 
and give the main results. We first recall that the model described by Eqs. Q is ill-defined for r = because the 
measurement noise on the resonator position x n (t) = U S Xn rj{t) is approximated by a Gaussian white noise. This 



implies that some quantities diverge in the limit r — > (see Eqs. (A8)), in particular the effective kinetic temperature 
T$ in the NESS which is given by 

T (v) = 7off-7' r + ± 7cff-7-y r , (82) 

' ! ! 7eff 7 7cff 

where T' = j'S Xn / (2r 2 ) has the dimension of a temperature (the important new feature is that T' diverges for r — > 0, 

(x) 

in contrast with the corresponding quantity in model V). On the other hand, the other effective temperature T eff , 
which is the one usually considered in experiments [3], remains finite in this limit 24 , 

^ = 7cff ' y(1+ - ) T + (Q ^) 2 ^ 
7cff t 7 off 

-+T^ + ^IT^-' (83) 

1 + g 2Q Q 1+g 



The present system, however, is quite different from the one studied in |38| which involves two interacting Brownian particles and two 
NESSs that can be controll ed in dependently. Here, there is only one Brownian entity and a single steady state. 

y(x, v, t), as denned by Eq. \7l\ , is in fact the minimum mean-squared error (MMSE) estimator of y for given x and v, that is the Bayes 
estimator that minimizes the mean-squared error < ( y — y) 2 >, where the expectation is take n ov er x, v and y. Since all variables are 
jointly Gaussian in the NESS, this estimator is a linear function of x and v, as shown by Eq. 174|. 

This is also true for the apparent EP defined in [36]. This trajectory-dependent functional does not obey a FT if the dynamics is 
described by the original Langevin equation (only FT-like symmetries may be preserved, depending on the experimental parameters). 
On the other hand, if one defines an effective dynamics (which generates different stochastic trajectories) by replacing the actual force 
acting on the observed particle by its conditional expectation computed with the full stationary probability distribution, the apparent 
EP then obeys a FT with this effective dynamics. 

Here, to facilitate the comparison with experiments, we use the parameters to = m/7, uio = \J k/m and Qo = V mfc/7 to describe the 
resonator instead of k, m, and 7. The temperature T ff is denoted T mot j e in |3]. 
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which is Eq. (5) in [3] (with Ub = 1 and the two-sided convention for the spectral densities, see footnote [29] in 
Appendix A). As pointed out in Appendix A (see Eqs. (A13)), this can be traced back to the behavior of S xx (oj), 
the power spectral density (PSD) of x, at large frequencies: in the limit r — > 0, the integral of S xx (uj) over u> is finite 
whereas the integral of S vv (u>) = u) 2 S xx (u>) diverges, which is also the case for the integral of S x i x i (w), the PSD of the 
measured displacement x' = x + x n (i.e. the PSD of the detector output) 25 . 

Another significant difference with model V is the fact that there is no positive value of the feedback gain g = Y/7 
for which the resonator is at equilibrium with the environment. This can be readily seen from the above equations 



which show that T j and T^g cannot be simultaneously equal to the heat bath temperature T. In other words, the 
detailed balance condition is never satisfied and there is always dissipation in the system 26 . 

Using the same method as previously, we first define the apparent EP at the ensemble level. The Fokkcr-Planck is 
somewhat more complicated than in model V and reads 



d tPt {X) = -d x [v Pt (X 
V d 2 



1 



in 



d v 



[{k +—)x + jv- —y]p t (X) 

T T 



1 



9 v [(y - x)p t (X) 



7T + 7T' d 2 
m 2 dv 2 



Pt(X) 



i dy 



2T' d 2 
2 Pt(X) - —-^^zPtiX) , 



to dvdy 



(84) 



the cross derivatives arising from the fact that the noises in the r.h.s of Eqs. (9a) and (9b I are correlated. However, 



these terms to do contribute after integrating over y, and the FP equation for the marginal probability distribution 

Pt(x,v) — J dy p t (x,v,y) can be written as 



d t p t (x,v) 



-d x [vpt(x,v)] - —d v 
to 



7 

[-(k H )x + Ffb(x, v,t))pt(x,v) + J t (x,v) 

T 



(85) 



where the current Jt{x,v) has the same expression as in model V (see Eq. (|69|), and the apparent feedback force is 
now defined as 



7' tT 

Ffb(x,v,t) = —[y(x,v,t) d v lnp t (x,v)\ 

t m 



(86) 



with y(x , v, t) given by Eq. \7l\ . This is the main difference with model V, and and S m (t) are again given by 
Eqs. (29) and (30) in the entropy balance equation (48), whereas the entropy pumping is 



S pu (t) = — / dxdv p t (x,v)d v F[ b (x,v,t) 
m J 

i f tT' 

= / dxdv p t {x,v)d v [y t (x,v) d v lnp t (x,v)] 

Tin / m 



(87a) 
(87b) 



Eq. (87b I is in general different from Eq. (72b), but the entropy pumping rate in the NESS, after using Eq. (74) 



and Eq. (A9b), can be again expressed as 5*p U = —7' /to with an apparent friction coefficient 7' given by Eq. (75b). 
Similarly, £ and S m are given by Eq. (36a) and Eq. (37a), respectively. Hence, all the terms in the entropy 



balance equation are formally the same as in model V and only the value of the effective kinetic temperature changes. 
Explicitly, we obtain 



1 cS 



7 



[7T - (7 cff - 7 - "f')T' 



mieft hhefi ~ l')T + 7'(7eff - 7 - i)T')T 



S =9.- 

<~>m rp 



j -yT - (7 cff - 7 - 7 7 )r 7 

TO7eff T 



(89) 



In the analysis of the experimental spectra, the integration over ui is actually performed in a limited band around the resonance frequency 
t^o (see for instance the discussion in I67| for the LIGO interferometer). In model P, r sets the minimal accessible time scale and in 
principle the upper limit of the integrals must be of the order of 2tt/t. This limit can be extended to +oo if the integrals converge. 

(x) (v) 

It does exist a value of g for which XLg = T, but the corresponding kinetic temperature T ff ' s then larger than T. In practice, this 
value of g is very large (see Fig. 3(a) for instance) and this situation has not been observed experimentally to the best of our knowledge. 



17 



and 



77 



lT - (7 off - 7 - 7')T" 



m 7(7 c ff - 7')? 1 + 7'(7cff - 7 - 7')^' 



(90) 



with 7 c ff given by Eq. (A6). As it must be, the results of [ST] recalled in section 3 are recovered by setting T' = 

(i.e. S Xn — 0) and r = 0. On the other hand, if ^ 0, both S and SVn, diverge like 1/r as r — > (whereas the 
entropy pumping rate stays finite), as a consequence of the divergence of the noise temperature T' , 



To derive an effective Langevin equation in the NESS, we cannot simply replace y by y s t(x,x) in Eq. (8a) as this 
would introduce an effective mass in the problem. What must be done is to project both y and the noise 77 on the 
subspace spanned by the variables x and v. We thus define 



_ , . < rj o x > < r\ o v > 
rj st x, v) = x + — 1 

< x 1 > st < v 2 > st 



2T 



(91) 



off 



where we have used < 77 o x >= and < r] o v >= — 1/(2to)v / 2t 7 T 7 to derive the second equality. Then, replacing y 
by 2/st(£,£) and rj by ?7 s t(a;,i;) into Eq. (9a) yields the effective Langevin equation 



m£+( 7 + 7')± + (fc+--- — )x = y/*yT£(t) , 

T T CT1.1 



(92) 



which can be exactly rewritten, using Eqs. (74), (A9b), and (A9c 
dissipated in the environment is defined as 



as Eq. (80) in model V . The apparent heat 



<?[{a; s }] = TAs m [{x s }} = - ds [mx s + ^'x a + (k 



1_ 

T 



7 0~1,3- 

t via' 



(93) 



and the corresponding apparent EP functional <r[{:r s }] = As sys + As m [{x s }] + (7' /m)t obeys fluctuation theorems 



with the trajectories generated by Eq. (92) and the conjugate equation (where 7' is replaced by —7' but 7' in the 



coefficient of x is not changed), while giving back Eq. (88) upon averaging. 

Finally, we can again compare the apparent EP to the (total) EP in the super-system that contains the full statistical 
information on the degrees of freedom x and y. The calculation is more complicated that the one performed in 
Appendix C for model V because the noises coming into play in Eqs. ([9| are correlated. Here, for brevity, we only 
give the expression of the entropy balance equation in the NESS, 
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S v 

(v) 

ff 



T IT 



(v) 

ff 



T. 



(x) 



eft 



m T t T' 

i (jT + yr)T + ( lcfi - 7 



i)T n 



m-7cff 



TV 



(94) 



where Eqs. (A9) are used to obtain the last expression. This quantity does not vanish for T 1 = T and it can be 

easily checked that it is always larger than E. We also notice that TS m + T'S m ' — (7' /rn)T' . Therefore, if one 
associates T'S m > to the heat flow Q' from a second reservoir at temperature T' , one has Q + Q' 7^ 0. Accordingly, 
t ^ Q(l/T - 1/T'), in contrast with model V. 

To illustrate the above equations, let us consider the feedback cooling of the fundamental mechanical mode of 
a cantilever. As an example, we take the ultrasoft silicon cantilever studied in [3], with intrinsic quality factor 
Qo = 44200, resonant frequency luq — 3.9KHz, and spring constant k — 86fj,N/m. This cantilever is cooled from a base 
temperature of 4.2 K, and the spectral density of the measurement noise is y/ S Xn ~ 10~ 2 A/vTIz, as estimated from 



This is not surprising since the effective Langevin equation, by construction, must yield the same marginal probability distribution 
p B t(x,v) as Eqs. J9I, and this quantity has formally the same expression in models V and P, and only the effective temperatures T^g 
and Ty are different. 
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FIG. 2: Spectral density S s i x i(u) (in A /Hz) given by Eq. (A13bl for different values of the feedback gain g. The resonator 



parameters correspond to the cantilever 1 studied in j3] (see text). The cantilever is cooled from a base temperature T = 4.2K. 
From top to bottom: g — 0, 544, 1321, 5690. Black dashed lines: r = 0; red solid lines: r = 0.1ms. 



fits of the measured spectra. Specifically, we take S Xn = 4.10~ 4 A 2 /Hz, which from Eq. (83) yields T^\g = 544) = 8.3 
mK for r = in agreement with the value indicated in Fig. 3 of [3J. Finally, we choose the value r = 0.1ms for the 
relaxation time of the feedback mechanism. This choice is rather arbitrary and is mainly done to illustrate the model 
behavior (the actual relaxation time in the experiment described in [3] is certainly much smaller: see the discussion at 
the end of the section). Note that this value is much smaller than the effective momentum relaxation time tq/(1 + g), 
even for the largest value of g considered in the experiments (and moreover 2t:/t 3> u)q). This guarantees that the 
resonator is still efficiently cooled in the vicinity of its resonant frequency. 

As shown in Fig. 2, this sm all but finite value of r slightly modifies the measured spectral density S x i x >(u)) of the 
cantilever computed from Eq. ( A13b|. In particular, the resonant frequency is now dependent on the feedback gain 28 . 
Note that the peak in S x i x /(uf) changes into a dip in the high gain regime as the detector noise sent back to the 
Brownian system dominates and acts to heat the mechanical device, an effect known as "noise squashing" [3J [31 US] . 
Accordingly, integrating the observed spectrum S x i x i (to) over oj leads to an underestimation of the actual resonator 
temperature. The true resonator motion S xx (uj) can be recovered by using the theoretical expression, Eq. ( |A13a ), or 
can be directly measured by adding a second transducer outside the feedback loop 68 , 69J . 

As could be expected, in presence of a finite relaxation time, the feedback cooling becomes less effective, and the 
minimal achievable temperature T*v increases, as shown in Fig. 3 (a), albeit very slightly (from 4.3 mK for r = 

(x) (v) 

to 4.6 mK for r = 0.1ms). On the other hand, for this value of r, the two temperatures T cff and T cff are very close 
one to each other around the minimum. Accordingly, the apparent EP rate £ displayed in Fig. 3(b) is maximal when 

(x) .... . ~ 

T eff is close to its minimum. We also notice that the essential contribution to £ comes from the entropy pumping 
since S m is very small in the whole range of g that is experimentally explored. This was also observed in model V 
for r = (see Fig. 1). This picture changes for much larger values of the gain (typically g > 10 6 ) as the resonator 

is heated instead of cooled. The main contribution to £ then comes from the heat dissipated into the environment 
and entropy pumping is negligible. £ thus reaches a minimum for some large value of g (beyond the scale of Fig. 3 
(b) and unrelated to the minimum observed for the total EP rate E), but in contrast with model V, this minimum is 
positive since there is always dissipation in the system, as we already stressed. 



The shape of the PSD may significantly change if t is large, especially if the quality factor of the oscillator is small. Such effects are 
discussed in |46| . Since this is not the main purpose of our work, we have not performed a systematic study of the model behavior as a 
function of the different parameters. 
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3: (a) Resonator temperature T^j) as a function of the gain g for r = (black dashed line) and r = 0.1ms (black solid 

for r = 0.1ms. (b) Different contributions to the entropy production rate for 
1 88k, (89}, and |90k : E (black solid line), S m (red solid line), 5 pu (blue solid line). The dashed 



FIG. 

line). The red line is the kinetic temperature T~ 
t = 0.1ms according to Eqs 



line is the total entropy production rate E in the super-system given by Eq. (941. 



Finally, let us again emphasize that the feedback relaxation time r is expected to play a role only for resonance 
frequencies in the MHz range onwards. In this respect, the value r = 0.1 ms chosen here for illustrative purposes only 
is certainly too large. Taking a much smaller value would drastically change the qualitative picture in Fig. 3 since 

£ and S m both diverge as t — > (whereas S pu is finite), as already noticed. This spurious behavior of the model 
comes from the (commonly made) assumption that the measurement noise is white. Introducing some cutoff at large 
frequencies would suppress these divergences and allow us to take a more realistic value of r. This, however, would 
add another (rather arbitrary) parameter in the model and somewhat complicate the description. 



V. CONCLUSION 



In this paper, we have generalized the results of PITE3"] to take into account the effect of measurement errors (or 
detector noise) on the entropy production (EP) in a cold damping process. This has led us to consider two models 
(called P and V) that distinguish whether the position of the resonator or its velocity (in practice an electric current) 
is the observable, as the two situations actually occur in experimental setups. We also have assigned a finite relaxation 
time to the feedback mechanism, which may play a role at high frequencies, but is also required to regularize model 
P when the detector noise is white. This makes the feedback control non-Markovian. 

To define the EP, we have adopted the viewpoint of the controlled system, as in p?TH23"] and in most recent studies 
of the thermodynamic behavior of feedback-controlled systems. In this framework, we have defined and computed in 
the noncquilibrium steady state the entropy pumping that describes the entropy reduction in the system due to its 
interaction with the external agent which manipulates the feedback control (and which in this case is not a genuine 
Maxwell's demon). For error-free measurements, the entropy pumping can be ascribed to the momentum phase space 
contraction induced by the additional damping force. The situation is more complicated in the presence of noise 
as one cannot any more relate the heat dissipated along a stochastic trajectory of the system to time irreversibility 
(more precisely, this identification would lead to an unphysical result, independent of the measurement noise). A 
proper relationship only exists if one considers the super-system that also includes the external agent, as done in |24j . 
Accordingly, in the presence of measurement errors, the entropy pumping cannot be simply associated to a contraction 
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of momentum phase space. This has led us to define the entropy pumping rate and the non-negative EP rate at the 
ensemble level by using the (coarse-grained) Fokker-Planck equation to derive the average entropy balance equation 
(i.e., the generalized second law). This is the proper generalization of the results of [21 . In particular, the EP rate 
(called the apparent EP rate as in [38] ) in the nonequilibrium steady state remains finite in the limit of error-free 
measurements whereas the total EP rate in the super-system diverges. Moreover, we have shown that the behavior 
of the apparent EP as a function of the feedback gain is consistent with the expected behavior of the dissipation 
in a cold damping setup: it is maximal when the feedback cooling is the most efficient. In the cooling regime, it is 
found that the main contribution to the EP comes from the entropy pumping whereas the average heat flow coming 
from the bath plays a negligible role. Measurement errors decreases the entropy pumping (in absolute value), and 
the dissipation is in turn reduced. It would be interesting to generalize these observations to transient regimes, for 
instance when the cooling is abruptly switched on or off, as considered in [2J. 

Finally, we have shown that trajectory-dependent functionals can be defined in the nonequilibrium steady state 
by replacing the original Langevin dynamics by an effective dynamics. The so-defined apparent EP functional then 
obeys fluctuations theorems with the new trajectories generated by this effective dynamics. 



M. L. R. is grateful to T. Sagawa and S. Ito for interesting discussions about the thermodynamics of information 
exchanges in nonequilibrium small systems. 

Appendix A: Stationary probability distributions and power spectral densities (PSD) for models V and P 

In this Appendix we compute the stationary probability distributions and the power spectral densities in models V 
and P. These quantities are easily obtained by noting that Eqs. ^ and ^ describe multivariate Ornstein-Uhlenbeck 
processes so that standard textbooks expressions can be used. To this aim, we rewrite these equations in the form 



where X is the 3-dimensional vector [x, v, y], T is a 3 x 3 damping matrix, and <fr is a 3-variate Gaussian process with 
zero mean and symmetric covariance matrix < <j)i(t)<f>j(lf) >= 2DijS(t — if). The explicit expressions of T and D are 
given below. The corresponding Fokker-Planck equation then reads 



Acknowledgments 



dX{t) 
dt 



rx(t) + *(t) 



(Al) 



9 tPt (X) = -^a Xj J t (i) (X) = ^5 ;E jr ij a ;j p t (X) + A J ^p t (X)] , 



(A2) 



and the stationary solution is given by the Gaussian distributionJSSl [70] 



PBt(X) = (2 7 r)- 3 / 2 [Dei C r]- 1 / 2 cxp(--X<x- 1 X) , 



(A3) 



where the covariance matrix er is solution of the algebraic matrix equation 



2D = Ter + Ta- T = Ta + e>T T . 



(A4) 



In model V, the 3x3 damping matrix T and the covariance matrix D are 




k/m j/m y/m 
-1/r 1/r 



0-10 



D = 



/ 

7 T/m 2 
\ T'/(t 2 7 ') 
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where T' ee -f'S Vn /2. By solving Eq. (A4) we then obtain the following expressions for the elements of the covariance 
matrix <x: 



where 



< X > st = CTi.! 



< V > st = (72,2 



< y > at = (73,3 



7cff-7 , (i + ^) r | yq + ^) r 

7eff k 7 off k 

7eff - l' T ^ 7' T" 
7eff m 7eff m 
7 T | 7 7cff-f^ r 
7effm 7efr 7'^ to 



< XV > st = (71,2 = (72,1 = 

< xy > st = (7i.3 = (73,1 = (T — T) 

™7off 

< «y >st = (72.3 = (73,2 = — (T ~ T') 

TO7cff 



7cff EE ( 7 + 7 ')(l+ — ) + 

TO T 

= (7 + 7')(l + -)+7(Qo-) 2 

TO T 



(A5) 



(A6) 



is an effective friction coefficient (recall that tq — m/7 and Qo = Vrnk/j = wqTq). Note the useful relations 29 



702,2 + 7 C2,3 = — J 

to 

m<r 2 ,2 ~ fcffi.i = 7' (71,3 



(A7a) 
(A7b) 



Similarly in model P, 



where T" ee / T 2 )S Xn /2. This yields 
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To 7eff 



7 7cff 



Note also that the most probable value of y for a given value of v is not v, which is a consequence of the non-Markovian character of 
the feedback control. 
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Note again the useful relations 



701,1 + 7 0-1,3 

7°2,2 



7T 
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7 7 
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(A9a) 
(A9b) 
(A9c) 



The power spectral densities of v (resp. x), the actual velocity (resp. displacement) of the resonator, and v' — v + v n 
(resp. x' — x + x„), the observed velocity (resp. displacement) are obtained by using the expression for the spectrum 
matrix of a multivariate Ornstein-Uhlenbeck process in the stationary state|70). 



S(w) = (r + iojl)- 1 (2T>)(T T - iujiy 1 



For model V, this yields 
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where 
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(A10) 



(Alia) 



(Allb) 



(A12) 



and Sp tb = 27T is the white spectral density of the thermal noise force 30 . 
Similarly, for model P: 



S x 'x' ( w ) 



(1 + r 2 uj 2 )/m 
\D{lo)\ 2 
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(Al3a) 



(Al3b) 



The o nly difference with the PSDs of model V is the absence of the factor lo 2 in the terms proportional to Sp th - Eqs. 
(A13) reduce to Eqs. (3) and (4) of [3] for r = 0. One can also check that T^> = k < x 2 > Bt = 1/(2tt) S xx {uj)duj 
m < v 2 > s t— 1/(271") S vv (uj)duj, which shows that the divergence of the kinetic temperature asr^O 



and T 



(v) 



cir 



is related to the behavior of S vv (uj) — urS xx (w) at high frequencies. 



Appendix B: Logratio of the path probabilities in the NESS (model V) 

In this Appendix we compute the quantity ln'P + [{cc s }]/'P_[{:z; s }] in the NESS for model V. 

In general, the path probability "P_|_[{x s }] can be obtained via two different routes. First, one can start from the 
conditional probability 7 : '[{X s }|Xo] of the path {X s } se [ t j = ({a; s }, {y s })se[o,t] given by Eq. (CI) in Appendix C 
and perform the path integral over {y s }. Second, one can consider the Langevin equation with memory and colored 
noised obtained by inserting the integrated expression of y(t) in Eq. (|7a[). This is the procedure used in |35j for a very 



In this work we use the two-sided convention for a spectral density, i.e. S ai 0(id) = Jjf^ e tu ' t <t>a,p{'k)dt where <f> a ,/3(t) is a time- 
translational invariant correlation function in the stationary state. Hence, Sp th = 27T for the PSD of the Langevin thermal force. On 
the other hand, the one-sided convention is often used in experimental papers, for instance in [3] (accordingly, S x „ , the spectral density 
of the measurement noise in [3] is two times larger than our S Xn ). 
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similar (but overdamped) model 31 . In the NESS, however, one can simply use the fact that P+^a^}] is Gaussian and 
given in the Fourier (frequency) domain by 



P + [{x s }] oc exp 



2tt 



x(u))S xx (cj) 1 x(-u) 



(Bl) 



where S xx (ui) = S vv (u))/u} is the power spectrum distribution of the position x (the normalization factor does not 
play any role in what follows). We stress that the influence of the initial conditions is neglected when going to the 
frequency domain, which is correct as long as one only considers expectation values 32 . Using the expression of S vv (u>) 
given by Eq. (Alia) and replacing S Vn by 2T' /j', we obtain after some simple manipulations 



V+[{x s }} oc exp 
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4 7 T 2tt 



x{uj) 
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(B2) 



where D(ui) is given by Eq. (A12). The probability "P_[{x s }] for the time-reversed trajectory is then obtained by 
replacing x(u>) by x(—u>) and changing 7' to —7'. This readily yields 



In 
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This logratio depends on the measurement noise via the presence of T" in the denominator. However, this dependence 
disappears when performing the average. Indeed, since S xx (ui) =< x{lu)x(~lo) > s t by definition, we obtain 



1 ln M^ll > - i 



ckd 7 + kr — mTU) 
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This integral can be computed analytically and after some tedious but elementary algebra we obtain the very simple 
result 



1 V+[{x s }} 

; <ln 7MR}T >s " 



7' 



m 7c ff 



(B5) 



with 7e ff given by Eq. (A6). This result generalizes Eq. (H4| for r > but cannot be taken as a pertinent definition 



of the EP rate since it is independent of the measurement noise. 



Appendix C: Entropy production in the super-system (model V) 

In this Appendix, we compute the entropy production in model V when the full statistical information on the 
microscopic degrees of freedom is available, that is when the two trajectories {x s } se to jt ] and {ys}s£[o,t] can be observed. 
The EP along the trajectory {X s } sG j t i can then be defined in the standard way from the logratio of the probabilities 
of the forward and reverse paths. Since the two noises £(i) and rj(t) are independent and Gaussian distributed, the 
probability of the path {X s }, conditioned on the initial state Xq = (xq, vq, yo), is given by 



7>[{X s }|X ] oc exp 
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4 7 T 



ds 



ix s 
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2*S*7i 



is ry s + y s 



(CI) 



As explained in 1351 . this route is only valid if the initial condition yo is chosen from a specific random distribution. Hence, this route 
is useful in the asymptotic long-time limit only. 

Indeed, we have shown in 1231 that the so-called 'boundary' terms may have a dramatic effect on large fluctuations, a problem that 
occurs when the position and velocity of the particle are unbounded; this issue was already pointed out in [71| . To obtain the correct 
expression of the boundary terms, there is no other choice than performing the functional integration of P[{X S }], which is a workable 
but tedious calculation. 
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The backward path {X s } s6 r 0j t] is then defined by the time-reversal operation x s = Xt- S ,x s 
—yt-s, which yields 



-x t -s,y s 



Dt-s,Va 



V[{X S }\X ] c<exp 
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Hence 



where 



ln P[{X s }|X ] 
7>[{X S }|X ] 



&8 m [{X a }] = ~J da (r 



2 



ds [ry s 



+ A Sm ,[{X s }] 

j'y s + kx s ) o . 
- i s ] o y s . 



As m '[{X s }] 

The total entropy production along the trajectory is then given by 

As m [{X s }}+As m ,[{X s }} 



(C2) 
(C3) 

(C4a) 
(C4b) 

(C5) 



where As sys = lnpo(Xo)/pt(X t ). By construction, <t[{X s }] satisfies the standard fluctuation theorems |18j. Note that 
y has been treated as an even variable under time reversal in order to derive Eq. ( C3 ) (despite the fact that it has 
the dimension of a velocity). This is indeed essential for recovering the correct expression of As m [{X s }] = q[{X s }]/T 
where <z[{X }] is the heat exchanged with the environment at temperature T, defined by Eq. (42 1 in the main text 33 . 
If one ignores the contribution of the boundary terms in Eq. ( C5 ) , which are not extensive in time and vanish on 

(C6) 



average in the NESS, the entropy production for long times in given by 



<r[{X s }]^ 7 '(i-i)^ ds 



y s °x s 



where V = 7%„/2 (this corresponds to Eq. (B7) in [55]V 

At this stage, the quantity As m /[{X S }] has no definite physical meaning. However, if T" is the actual temperature 
of a second heat bath coupled to the Brownian particle, and Eq. (7b) is rewritten as 



{l'r)y+l'(y-x) = y/2j>T>r 1 (t) , 
then one can identify As TO /[{X s }] with q'[{X s }]/T' , where 



q , [{X s }}= f ds [iljs-^T'ris] 
Jo 



= il ds [- T i)s + i s ] o y s 
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is the heat exchanged with this second reservoir. Interestingly, Eq. ( C6 1 is also the result obtained in [23] for the 
EP associated to Eq. ( 39 ) when the contribution of the feedback controller is included (indeed, note that the above 
equations have a well-defined limit for t = 0). In this case, as noted in section 4A, As ro /[{X }] corresponds to 
the time-continuous limit 18 of the quantity As p which is interpreted in [21] as the entropy production due to the 
measurement process. From the expression of As p (see Eq. (7) in [23])) one can easily see that the definition of 
the (discrete) reverse process proposed in [24] amounts to treating y as an even variable under time reversal in the 



In fact, the correct expression of As m [{X s }] can also be recovered with y odd and 7' changed to —7', but this does not give a sensible 
result for As m /[{X }] since this quantity then vanishes for r = 0. Here y plays the same role as the auxiliary variables Vi in 48_ that 
appear when mapping a generalized Langevin equation with exponential memory kernel and colored noise to a set of coupled Markovian 
equations. These variables are indeed even under time reversal (the same is true for the variable U defined by Eqs. (Bl) in |35|V 



25 



continuous-time limit. In this respect, it is not surprising that the EP of the full system computed in [53] obeys the 
detailed FT. 

Upon averaging, one recovers from Eq. ( C5 ) the balance equation obtained from the time derivative of the Shannon 

(C9) 



entropy. The Fokker-Planck equation ( 66 ) is then written as 



d tPt (X) = -d x [vp t (X)] - ^d v [-(kx + 1 'y)p t (X) + J t (X)] - -^dy^vptiX) + J t '(X) 



where Jt{X) and </ t '(X) are the irreversible components of the probability currents defined as 

J t (X) = -j[v + -d v ln Pt (X)] Pt (X) 
m 

J' t (X) = --/'[y+^-dylnptWMX) . 
7'r 



(CIO) 



(Note that J t '(X) is indeed the time-antisymmetric component of = — "/[(y — v) Pt {X) + T' /{^'T)d yP t{X)] because 
y is even under time reversal.) One then finds 



t(t) = S sys (t) + S m (t) + S m ,(t) 



where S m (t) = -(1/T) JdXv J t (X) = -(1/T) / dxdv v J t (x, v) is again given by Eqs. ((30j), 

S m ,(t) = ~ J dXyJ' t (X) 

7' r . 2 r 



1 ' 7'r 



and 



IT 



dX 



1 



Pt (X) T >T' 



dX 



[J t '(x)] ; 

Pt(X) 



(Gil) 

(C12a) 
(C12b) 

(C13) 



This latter expression is in agreement with the general expression of the EP rate in the full phase space when even 
and odd variables are present [55] . Furthermore, using the inequality 3 



one finds that 



dy [^( X )] 2 > [JdyJ t (X)} 2 = [J t (x,v)] 2 ^ 
Pt( X ) ~ f d yPt{X) Pt{x,v) 

[^ t '(x)] 2 • 



E(t) > £(*) 



7'T' 



dX 



>£(*) 



(C14) 



(C15) 



where £(i) = 1/(tT) fdxdvJ t (x,v)] 2 /pt(x,v) is the apparent EP rate considered in section 4.B. 
Finally, in the steady state, one obtains 

= rY {t-t'Y ^ 

mj cS TV 



(C16) 



which generalizes Eqs. (59) to r > as the heat flow Q is still given by Eqs. H (with T off replaced by T$). 
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